Groups of homeomorphisms of one-manifolds, III: 
Nilpotent subgroups 



Benson Farb* and John Franks^ 
February 1, 2008 



Abstract 



This self-contained paper is part of a series |FF1| , FF2 seeking to 
understand groups of homeomorphisms of manifolds in analogy with the 
theory of Lie groups and their discrete subgroups. Plante-Thurston proved 
that every nilpotent subgroup of Diff 2 (5 1 ) is abelian. One of our main 
results is a sharp converse: Diff 1 (S' 1 ) contains every finitely-generated, 
torsion-free nilpotent group. 



1 Introduction 

A basic aspect of the theory of linear groups is the structure of nilpotent groups. 
In this paper we consider nilpotent subgroups of Homeo(M) and Diff r (M), 
where M is the line R, the circle S 1 , or the interval I = [0, 1]. As we will see, 
the structure theory depends dramatically on the degree r of regularity as well 
as on the topology of M. 

Throughout this paper all homeomorphisms will be orientation-preserving, 



and all groups will consist only of such homeomorphisms. Plante-Thurston [PT| 
discovered that C 2 regularity imposes a severe restriction on nilpotent groups 
of diffeomorphisms. 

Theorem 1.1. Any nilpotent subgroup of Diff 2 (I), Diff 2 ([0, 1)) or Diff 2 (S" 1 ) 
must be abelian. 

Remark. In the case of subgroups of Diff 2 (7) and Diff 2 ([0, 1)) this result was 



first proved by Plante and Thurston in PI]. They also proved that the group 



is virtually abelian in the S 1 case. For completeness of exposition (and because 
it is simple) we present a proof of the Plante-Thurston result about /. These 



results are related to a result of E. Ghys [Gh], who proved that any solvable 
subgroup of DiS UJ (S 1 ) is metabelian. In §^ we prove the PL version of Theorem 

n 
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Our main result is that lowering the regularity from C 2 to C 1 produces a 
sharply contrasting situation, where every possibility can occur. 

Theorem 1.2. Let M = R, S 1 , or I. Then every finitely-generated, torsion- 
free nilpotent group is isomorphic to a subgroup of Diff 1 (M) . 



Witte has observed ([ Wi] , Lemma 2.2) that the groups of orientation-preserving 



homeomorphisms of R are precisely the right-order able groups. Since torsion- 



free nilpotent groups are right-orderable (see, e.g. MR |, p. 37), it fo llow s that 
such groups are subgroups of Homeo(R). The content of Theorem L2 is the 
increase in regularity from C° to the sharp regularity C . 

The situation for R is more complicated. On the one hand there is no limit 
to the degree of nilpotence, even when regularity is high: 

Theorem 1.3. Diff 00 (R) contains nilpotent subgroups of every degree of nilpo- 
tency. 

On the other hand, even with just a little regularity the derived length of 
nilpotent groups is greatly restricted. 

Theorem 1.4. Every nilpotent subgroup of Diff 2 (R) is metabelian, i.e. has 
abelian commutator subgroup. 



In particular, Theorem 1.4 gives that the group ofnxn upper-triangular 
with ones on the diagonal, while admitting an effective action on R by C 1 
diffcomorphisms, admits no effective C 2 action on R if n > 3. 

Closely related to this algebraic restriction on nilpotent groups which act 
smoothly is a topological restriction. 

Theorem 1.5. If N is a nilpotent subgroup o/Diff 2 (R) and every element of 
N has a fixed point then N is abelian. 

One open problem is to extend the above theory to solvable subgroups, as 
well as to higher-dimensional manifolds. The paper of J. Plante contains a 
number of interesting results and examples concerning solvable groups acting 
on R. Another problem is to understand what happens between the degrees of 
regularity r = and r > 2, where vastly differing phenomena occur. 

Residually nilpotent groups. A variation of our construction of actions 
of nilpotent groups can be used to construct actions of a much wider class of 
groups, the residually torsion-free nilpotent groups, i.e. those gro ups w here the 
intersection of all terms in the lower central series is trivial. In §2.4 we prove 
the following result. 

Theorem 1.6. Let M = R, S 1 or I. Then Diff+(M) contains every finitely 
generated, residually torsion-free nilpotent group. 

The class of finitely generated, residually torsion-free nilpotent groups in- 
cludes free groups, surface groups, and the Torelli groups, as well as products 
of these groups. 

Acknowledgements. It is a pleasure to thank Dave Witte for making several 



useful suggestions, in particular pointing us to the references [Ra|, 0], and [MR| 
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2 Constructions 



In this section we construct examples of nilpotent groups acting on one-manifolds. 

2.1 An elementary observation 

There several obvious relations among actions on the three spaces R, S 1 , and 
/. Restricting an action on I to the interior of I gives an action on R. One 
can also start with an action on R and consider the action on the one-point 
compactification S 1 or the two-point compactification /. But this usually entails 
loss of regularity of the action. That is, a smooth or PL action on R will 
generally give only an action by homeomorpisms on I or T 1 . 

2.2 C 1 actions on M 

Let Af n denote the group of n x n lower-triangular integer matrices with ones 
on the diagonal. Our first main goal is to prove that M n admits C 1 actions on 
the real line. 

The proof is somewhat technical and so we will describe the strategy before 
engaging in the details. The traditional proof that M n acts by homeomorphisms 
on the interval uses the fact that it is an ordered group. Suppose a group 
acts effectively on a countable ordered set in a way that preserves the order 
(e.g. the set might be the group itself), One can then produce an action by 
homeomorphisms on I by embedding the countable set in an order preserving 
way in / and canonically extending the action of each group element on that 
set to an order preserving homeomorphism of I, first by using continuity to 
extend to the closure of the embedded set and then using affine extensions on 
the complementary intervals of this closure. 

The approach we take is somewhat similar. We consider the group Z n of n- 
tuples of integers and provide it with a linear order >- which is the lexicographic 
ordering, i.e. (x\, . . . , x n ) ~< (yi, . . . , y n ) if and only if Xi — yi for 1 < i < k 
and Xk < yk for some < k < n. It is well known and easy to show that the 
standard linear action of M n on Z n preserves this ordering. 

Instead of embedding Z n as a countable set of points, however, for each 
(qi,..., q n ) G Z n we will embed a closed interval I(qi, ■ ■ ■ , q n ) in I. We do 
this in such a way that the intervals are disjoint except that each one intersects 
its successor in a common endpoint, and so that the order of the intervals 
in / agrees with the lexicographic ordering on Z n . We also arrange that the 
complement of the union of these intervals is a countable set. If for each a £ Af n 
we defined g a on I(qi, . . . , q n ) to be the canonical affine map to I(a(qi, . . . , q n )) 
this would define g a on a dense subset of / and it would extend uniquely to a 
homeomorphism, giving an action of 7V„ by homeomorphisms. 

In order to improve this to a C 1 action we must replace the affine maps from 
I(qi, . . . , q n ) to I(a(qi, . . . , q n )) with elements of another canonical family of 
diffcomorphisms which has two key properties. The first is that these subinterval 
diffcomorphisms must have derivative 1 at both endpoints in order to fit together 
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in a C 1 map. The second is that if Ik is a strictly monotonic sequence of 
these subintervals then the restriction of g a to Ik must have a derivative which 
converges uniformly to 1 as k tends to infinity. In particular, by the mean value 
theorem the ratio of the lengths of a(Ik) and Ik must tend to 1 for any element 
a G Af n . This makes the choice of the lengths of these intervals one of the key 
ingredients of the proof. We choose these lengths with a positive parameter K. 
We are then able to show that as this parameter increases to infinity the C 1 size 
of any g a goes to zero. This allows us to prove the existence of an effective C 1 
action of N n on I with generators chosen from an arbitrary C 1 neighborhood 
of the identity. 

We proceed to the details beginning with some calculus lemmas. The first 
of them develops a family of interval diffeomorphisms which we will us as a 
replacement for affine interval maps as we discussed above. We are indebted to 
Jean-Christophe Yoccoz for the proof of the following lemma which substantially 
simplifies our earlier approach. 

Lemma 2.1. For each a and b G (0, oo) there exists a C 1 orientation preserving 
diffeomorphism cf) a ^ : [0, a] — > [0, b] with the following properties: 

1. For any a, b,c G (0,oo) and for any x e [0, a], 0&,c(0a,&Or)) = </> a ,c( x )- 

2. For all aA < 6 (0) = < 6 (1) = 1. 

3. Given e > there exists S > such that for all x £ [0, a], 



< e, whenever 



b --l 
a 



< S 



du 



Proof. For u G (0, oo) we define 

r 

= 7-oo + Uf, 

A change of variables u — uqx allows one to conclude that 



1 f c 
L(v) = - / 



dx 



1 



IT 



For each tt G (0, oo) we define tl> Uo : R — > (0, L(uq)) by 



j —i 



du 



u + u 







Clearly ij) Uo is a real analytic diffeomorphism from R onto the open interval 
(0,i(«o)). 

Now define (j)a,b '■ [0, a] — > [0,6] by setting </> a ,b(0) — 0, (j) a ,b{o) = b and for 
x G (a,b) letting 4> a ,b(x) = ip Ul {^Pu^ix)) where a — L(uo) and b = L(u\). This 
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is clearly a homeomorphism of [0, a] to [0, b] which is real analytic on (0, a). We 
observe that the derivative of (j) a ,b(x) at the point x = "4> Uo (t) is given by 



4>'aA x ) = 



C (*) * 2 + ' 



t 2 + ul 



From this it is clear that 4>' a bi x ) can be continuously extended to the end- 
points of the interval [0, a] by assigning it the value 1 there. Hence <f> a ,b{%) is 
C 1 on the closed interval [0, a] and satisfies property (2) above. Property (1) is 
clear from the definition. 

To check property (3) we observe that if, as above x = ip uo (t) then 



<P'a,b( X ) - 1 



ul 



- 1 



f 2 + u\ 

which is easily seen to assume its maximum when t = 0. But 



< 



}4 _ , 



since uq = ir/a and u\ — ir/b. From this it is clear that property (3) holds, o 

We will also need the following technical lemma. 

Lemma 2.2. Suppose n is a positive even integer and K > 0. Then for (x, y) G 
R 2 



lim 



. y y _ y r. 



,oo x n + 2 + y n + K 
Moreover, given e > 0, for K sufficiently large 

\{x + yY-y n \ 



0. 



x n+2 +y n +K 



< e 



for all (x, y) £ R 2 . 



Proof. The numerator (x + y) n — y n is a sum of mononomials of the form 
Cx k y n ~ k where < k < n. Hence it suffices to prove 



lim 



\x\ k \y\ n - k 

oo x n + 2 +y n + K 



= 



for < k < n. 

If for some e > 



\x\ k \y\ n ~ k 



> e 



x n+2 +y n +K 

we want to show that there is an upper bound for \x\ and \y\. 
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Wc first observe that 



\x\ k \x\ k \y\ n - k \x\ k \y\ n ' k > ^ 



or 



y ]k | y |n ' a-n+a+yn + j^ 

M>£ 1/fc M (i) 



Similarly, 



\y\ n ' k _ \x\ k \y\ n ~ k > \x\ k \y\ n ~ k > 



\ x \n-k+2 \ x \ n + 2 x n+2 +y n +K 



This implies that 



y\ n - k > e\x\ n - k+2 (2) 



and we note that n — k + 2 > 0. In the case that k = n we note that equation (^|) 
implies that |a;| is bounded and then equation (|l|) implies that \y\ is bounded. 
On the other hand, when k < n we have 

\y\>E\x\ d (3) 

where 

i , , 7i -k + 2 _ 2 
E = e»- fc and a— — 



k n — k 

Combining equations (|l|) and (||) we see 

|z| >e 1/k \y\ >e 1 ' k E\x\ d 

Since d > 1 this clearly implies that \x\ is bounded by a constant depending 
only on n and e. Then equation (jl|) implies that |y| is also bounded. The 
contrapositive of these assertions is that for ||(a;,?/)|| sufficiently large we have 



x n+2 + y n + K 

which implies the desired limit. 

To prove the second assertion of the lemma we observe that we have shown 
there is a constant M > such that 

(x + y) n -y n 

< e 



c n+2 _|_ y n _|_ X 



whenever ||(a;,j/)|| > M. Morever the constant M is independent of K. Hence 
clearly if K is sufficiently large, this inequality will hold for all (x,y). o 

Consider the group Z n of n-tuples of integers and provide it with a linear 
order >- which is the lexicographic ordering, i.e. (x±, . . . , x n ) -< (yi, . . . , y n ) if 
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and only if Xi = yi for 1 < i < k and Xk < yu for some < fc < n. We are now 
prepared to define a set of closed intervals in one-to-one correspondence with 
elements of Z n . As mentioned above we will make this definition with a positive 
parameter K which will be used subsequently to get generators of our action in 
an arbitrary C 1 neighborhood of the identity. 

Definition 2.3. For K > let B K : Z n -> R be defined by 

n 

B K ( qi , q2} ..., qn ) = K + J2qT^ +2 

„2n , J2n-2 , , 4 , J2 , v 
= Ql + c h H 1" 1n-l + In + K i 

and let the constant Sk be defined by 

1 



( 9 l,g 2 ,...,9n)eZ n 

For (n,r 2 , • • • ,r„) we rfe/i^e S K {n,r 2 , ■ ■ ■ ,r n ) by 

S K {ri,r 2 ,...,r n )= V -, r. 

, B K (q 1 ,q 2 ,...,q n ) 

(qi, 92, ■■■,qn)<{ri,r 2 , ...,r„) 

Finally we define the closed interval 

lK{n,r 2 , ...,r n ) = [S K {ri,r 2l . ■ . ,r n ), S K {r\,r 2 , ...,r n + 1)]. 

Note that the sum defining converges, for example by the integral and 
comparison tests, so that Sk is well-defined. We will denote the interval [0, Sk] 
by Ik and we note that it is nearly the union of the intervals Ik^i, r 2 , . . . , r n ). 

Lemma 2.4. There is a countable closed set Jk in the interval Ik = [0, Sk], 
such that 

I k = Jku( (J Ix(qi, 52,- ...tfn)) 

(91,92, ...,9„)£Z" 

Proof. Define by the equality in the statement of the lemma. From the defi- 
nitions it follows that every point Jk is the limit of one of the Cauchy sequences 
{Sk (fi, •■• . . . r„)} as ranges from 1 to either oo or — oo and the other 
rj,j ^ i are fixed. It follows that Jk is countable. The set Jk is closed since 
its complement is clearly open, o 

We note that the intervals {lK(qi, 92, • • • , q n )} occur in the interval Ik in 
exactly the order given by -< . They have disjoint interiors but each such interval 
intersects its successor in a common endpoint. 

Definition 2.5. Let v : Ik\Jk — * Z n be defined by setting v(x) = (qi, q 2 , . . . , q n ) 
ifx E I K (qi,q2, ■ ■ -,q n ) and x I K (q 1} q 2 , . . .,q n+ i). 
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Lemma 2.6. If K is sufficiently large, then for every a £ Af n there exists a 
homeomorphism g a : Ik —> Ik such that for each (qi, . . . , q n ) £ Z n , 

1- g a {lK(qi, ■ ■ ■ ,q n )) = -Tfir(a(<7i; ■ ■ ■ ,q n )), and 

2- g a /3( x ) — 9a(9p( x )) f or all ce, /3 £ N n and all x £ Ik- 

3. for x £ I K (qi, ■ • ■ , q n ), g a (x) = (f>b u b 2 ( x ~ c i) + c 2, where 

h = \Ik(qi, ■ ■ -,q n )\ = B K {qi, ■ ■ .,t? n ) -1 , 
b 2 = \I K (a(qi, ■ ■ .,q„)\ = B K (a(qi, . . . 
ci = S K (qi, ■ ■ - ,q n ), and 
C2 = S K (a(qi, ■ ■ • ,q n ))- 

and <pb!,b 2 '■ [0, &i] — * [0,62] is the diffeomorphism guaranteed by Lemma 



2.1 



Proof. For x £ Iic(qi, ■ ■ ■ , 9n) 5 we define g a (x) to be cf>b 2 (4>b~i ( x — c i)) + c 2- The 
values of the constants bj,Cj, for j = 1,2 were chosen so that (1) holds. This 
gives a homeomorphism g a from J^- \ Jif to itself which preserves the order on 
the interval Ik ■ Since Jk is a closed countable subset of Ik we may extend g a 
to all of Ik in the unique way which makes it an order preserving function on 
Ik- Clearly this makes g a a homeomorphism of Ik to itself. 

In order to show property (2) we let 63 = BK(j3a{q\, . . . , (Zn))" 1 and C3 = 
S K (f3a(qi, . . . , q n )). Then if x £ Iniqi, qn), 



g/3(g a ( x )) = 4>b 2 ,b 3 (ga{ x ) -c 2 ) + c 3 



= 4>b 2 ,b 3 {(l>b u b2({ x - c i) + c 2 - c 2 ) + c 3 , by Lemma |2.1 
= <j>bi,b*{n - ci) + c 3 

Since this holds for any (qi, , . . , q n ) £ Z n we have shown gp{ga{x)) = g0 a {x) 
for a dense set of x £ Ik ■ Continuity then implies this holds for all x £ Ik ■ o 

Definition 2.7. For 1 < i < n let cr,; £ A/"„ denote the matrix with all entries 
on the diagonal equal to 1, with entry (i + equal to 1, and with all other 
entries 0. We will denote the homeomorphism g <Ti : Ik — > Ik by gi. 

The elements {o~i\ form a set of generators for the group M n . Our next 
objective is to show that in fact gi = g ai is a C 1 diffeomorphism. For this we 
will need a sequence of technical lemmas. 

Lemma 2.8. Suppose Xk is a monotonic sequence in Ik \ Jk converging to a 
point of Jk- Then for each 1 < i < n 

Um BKj^ivjxk))) _ i 
fe^oo B K {v{x k )) 
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Proof. We may assume without loss of generality that the sequence {x k } is 
monotonic increasing. For 1 < j < n, k > we define qj(k) by v(x k ) — 
(qi(k), (?2(fc), • ■ ■ ! 1n(k))- Then each sequence {qj(k)} k x L 1 is monotonic increas- 
ing. At least one of these sequences is unbounded, since any bounded ones are 
eventually constant and if {qj(k)} were eventually constant for all j < n then 
the sequence of intervals lK(v(x k )) would be eventually constant and the limit 
of the sequence {xk} would be in the final interval and hence not in Jk- Let r 
be the smallest j such that {qj(k)} is unbounded. Then since {xk} is monotonic 
increasing we have lim^oo q r (k) = oo and for j < r the sequence {qj(k)} is 
eventually constant. 
We note that 

B K (i7i(i'{xk))) = B K (q 1 (k), . . . ,qi(k),q i+1 (k) + qi(k),q l+2 (k), . . . ,q n {k)) 
and hence that 

B K Wx k )) - B K {<JiWx k ))) = (q t+1 (k) + qi (k)) 2n ~ 2 * - q l+1 (k) 2n - 2t 
B K {v{x k )) B K (q 1 (k),...q n (k)) 
= P( qi (k),q i+1 (k)) 
B K (qi{k),...q n {k)) 

where P(x, y) = (x + y} 2n ~ 21 — y 2 ™- 21 . 

We first consider the case that r > i + 1. Then for large k we have that 
P(qi(k), <7i + i(fc)) is bounded (in fact eventually constant) so 

lim B K {v{x k )) - B K (o- t {v(x k ))) = P{q l {k),q, l+1 {k)) = 

k^oo B K (v(x k )) k^oo B K (q 1 (k), . . . ,q n (k)) 

and we have the desired result. 

In case r = j + 1 or r = j we observe 

P{ gi {k),q i+1 (k)) < P{ qi {k),q l+1 {k)) 



qi(k) 2n + ■■■ + q n (k) 2 + K ~ q t {k) 2n - 2l + 2 + q l +i(k) 2n ^ 2i + K 

and at least one of qi(k) 2n ~ 2%+2 and qi+i(k) 2n ~ 2 ' 1 tends to infinity so by Lemma 
2.2 we again have 

B K {y{x k )) - BKiaiiyixk))) P( qi (k),q i+1 (k)) 
am — - — — = lim — — — — — - = (J 

fc^oo B K (v{x k )) fc^oo B K {qi{k), . . . , q n (k)) 

Finally in case r < i 
\P( qi (k),q l+1 (k))\ < \P( qi (k),q i+1 (k))\ 



B K ( qi (k), . . . , q n (k)) ~ q r {k) 2n - 2r + 2 + qi (k) 2n - 2 *+ 2 + q t+l (k) 2n - 21 + K 



and \q r {k)\ tends to infinity. But given e > by Lemma 2.2 there is an M > 
such that whenever ||(gj(fc), gj + i(fc))|| > M we have 

\P( qi (k),q i+1 (k))\ 



q r (k) 2n - 2r + 2 + q t (k) 2n - 2l + 2 + q t+1 (k) 2n - 21 + K 
\P(q t (k),q l+1 (k))\ 
~ qi (k) 2n - 2i + 2 + q l+1 (k) 2n - 2i + K 
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On the other hand if || gj+i(fc))|| < M and | (fc) | is sufficiently large 

\P(qi(k),q i+1 (k))\ 

q r (k) 2n - 2r + 2 + qi (k) 2n - 2i + 2 + q t+1 {k) 2n - 21 + K 

So in all cases we have the desired limit 



< £ 



which implies 



and hence that 



\B K {v(x k )) - B K {ai{v{x k )))\ 

llm „ , -, = 

fe^oo B K {v(x k )) 

B K {vi{v{xh))) 



lim 



1 - 



B K (v{x k )) 



= 



Um B K ((Ti(i>(xk))) _ 1 
fe^ TC B K (v(x k )) 



(4) 



Lemma 2.9. Suppose x k is a monotonic sequence in Ik \ Jk converging to a 
point of Jk- Then for each 1 < i < n, 

lim g'^xk) = 1. 

k— »oo 

Proof. For a; € /a'(<7i, ■ • ■ , ffi is defined by gi(x) = <ft blM (x - c 2 ) + Ci, for 
some constants ci and C2, where 



1 



B K {v{x k )) 



and 62 = — 



-BAr(CTi(i/(x fc ))) 



So g'^Xk) = <i>' bub2 (x k ). 

We wish to show that given e > for fc sufficiently large |1 — <^(xfc)| < £. 
To do this, by Lemma 2.1 we need only show that for any 5 > 



< S 



for sufficiently large k. 
But 







h(k) 





B K (v(x k )) 



B K {o-i{v{x k ))) 



which, by Lemma 2.8 tends to as k tends to infinity. Hence 

b 2 {k) 



h(k) 



1 



< S 
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for k sufficiently large, o 



The proofs of Lemmas ( 2.1 0| ) and (2.11) below are parallel to those of Lem- 
mas (2.8) and (|2.9p. The difference is that before we were interested in the 



limiting values of some quantities as a sequence {xk} of values of x in Ik \ Jk 
converged, while now we are interested in estimating the same quantities but, 
uniformly in i, as the parameter K tends to infinity. 

Lemma 2.10. Suppose 1 < i < n. Given e > there is a Kq > such that 
whenever K > Kq 



B K ((Ti(u( X ))) 



B K (u{x)) 



1 



< £ 



for all x G Ik \ Jk ■ 



Proof. For 1 < j < n, we define qj(x) by v(x) = (qi{x), q2(x), . . . , q n (x)). 
We note that 

B K {<Ji{v{x))) = B K (qi(x), . . . ,qi(x),q i+ x(x) + q t (x) , q i+2 (x) , . . . ,q n {x)) 
and hence if P(u, v) = (u + w ) 2 "^ 24 — y 2n-2t ^ we ]^ ave 

B K {u{x)) - B K (aMx))) (q l+1 (x) + qi (x)) 2n - 21 - q t+ i(x) 2n - 



B K {v{x) 



B K {qi{x) 1 . . . q n (x) 
\P(qi{x),q l+ i(x)\ 



< 



B K {qi{x),. . .q n {x)) 

\P{qz(x),qi+i(x))\ 

q,(x) 2n -^+ 2 + q i+1 (x) 2n - 2i +K' 



So by the second part of Lemma (2.2) we conclude that if K is sufficiently large 
B K {v{x)) - B K (o-i{v(x))) 



From this we see 



B K {v{x)) 
B K {o-i{v{x))) 



< £. 



(5) 



B K {v{x)) 



< £ 



as desired, o 



Lemma 2.11. Given e > 0, if K is chosen sufficiently large then for all x £ 
Ik \ Jk and all 1 < i < n 

\g'i(x)-l\ <£. 
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Proof. For x £ Ik^i, <?«), 9i is defined by gi{x) = (j>b u b 2 (x - c 2 ) + c\, for 
some constants c\ and c%, where 



h = b\{x) 



1 



B K {y[x)) 



and 62 = ^2(2^) 



1 



B K {<ji{v{x))y 



$og' i {x)=4>' biM {x). 

We wish to show that given e > 0, if K is sufficiently large then 1 — <^(x) | < e. 
To do this, by Lemma we need only show that given any 5 > there is a 
-FsTq > such that K > K implies 



b 2 (x) 



bi(x) 



< 5 



for all x £ Ik\Jk- 
But 



b 2 (x) 



h{x) 



- 1 



B K {aMx))) 



B K {v{x)) 



and the result follows from Lemma 2.10. o 



Proposition 2.12. For K sufficiently large the homeomorphism gi : Ik —> Ik 
is a C 1 diffeomorphism with derivative 1 at both endpoints. Given e > there 
exists Kq such that whenever K > Kq we have 

\g'i(x)-l\<e 

for all x G Ik- 

Proof. We know that th e function f(x) — g'^x) exists and is continuous on 



Ik \ Jk- By Lemma (2J5) we can extend it continuously to all of Ik by setting 
f(x) = 1 for x £ Jk- 

We define a C 1 function F by 

F(x)= f f(t)dt 



and will show that F(x) — gi{x). To see this let <f)(x) — gi{x) — F(x). Then 
0(0) = and cj>(x) is a continuous function whose derivative exists and is 
on Ik \ Jk- Since Jk is countable 4>(Jk) has measure zero. But Ik \ Jk has 
countably many components on each of which <f> is constant. It follows that 
4>{Ik) has measure zero and hence 4>(Ik) — {0}. Therefore gi(x) = F(x) is C 1 . 



Lemma (2.11) and the fact that g[{x) — 1 for x £ Jk imply that for K 



sufficiently large 

\gl(x) -l\<e 

for all x £ Ik- The inverse function theorem then implies that gi is a C 1 diffeo- 
morphism. 
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Recall that we have given the group Z n the lexicographic ordering, >- i.e. 
(xi,...,x n ) >- (yi, ■ ■ ■ , Vn) if and only if Xi = yt for 1 < i < k and x k > y k 
for some < k < n. We note that this order is translation invariant, indeed 
(xi, ...,x n )y (y%, . . . ,y n ) if and only if (xi - yi, . . . , x n - y n ) >- (0, . . . ,0). 

It is well known and easy to check that the nilpotent group Af n ofnxn lower- 
triangular integer matrices with ones on the diagonal acts on Z n preserving the 
order >-. 

Theorem 2.13. The group Af n is isomorphic to a subgroup of Diff 1 (M) for 
M = R, S\ or I . For M = S or I the elements of this subgroup corresponding 
to the generators {ui} of M n may be chosen to be in an arbitrary neighborhood 
of the identity in Diff 1 (M) . 

Proof. We first consider the case that M = /. Given e > we choose K 



sufficiently large that the conclusion of Pro posit ion ( 2.12 ) holds. We define 



$ : Af n — * Homeo(Iif) by <E(q) = g a . Lemma (2.6) asserts that $ is an injective 



homomorphism. Proposition ( 2.12 ) asserts that = $(o"i) is a C 1 diffeomor- 
phism so in fact Q(Af n ) lies in Diff (Ik)- 

Define the injective homomorphism ^ : J\f n — > Diff 1 (7) by ty(a)(x) = 
Sk^{ol)(x / Sk) — Sk9u{x/ Sk)- Restricting this action to the interior of / 
givens an action on R. 

Note that every element of 4 , (7V n ) has derivative 1 at both endpoints of /. 
Gluing endpoints together gives an action on S 1 . 

In the case M = S 1 or / we clearly have \^{ai)'(x) — 1| < e by Proposition 



(2.12) o 



Now every finitely-generated, torsion-free nilpotent group N is isomorphic 



to a subgroup of N n for some n (see Theorem 4.12 of [Ra] and its proof). This 



together with Theorem 2.13 immediately implies Theorem 1.2. 



2.3 C°° actions on R 

For certain nilpotent groups we can give a C°° action on R. But we will see in 
the next section that for n > 2 there is no C 2 action of Af n on R. 



Proof of Theorem 1.3: Choose a non-trivial C°° diffcomorphism a of [0, 1] 
to itself such that for j = 0, 1 we have a(j) = j, ct'(j) — 1, and (J) = 0, for 
all k > 1. 

Define three C°° diffeomorphisms f,ho,hi : R — > R by 
fix) =x-l 

ho(x) — a(x — m) + m for x S [m, m + 1] 
hi(x) = a m {x — m) + m for x G [m, m + 1] 

Then it is easy to check that ho and hi commute, / and ho commute, and 
[/, hi] = f~ 1 h^ 1 fhi = h . Hence the group generated by / and hi is nilpotent 
with degree of nilpotency 2. 
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Given any n > 0, we will inductively define h k for < k < n in such a way 
that h{m) = m for m G Z, [/, /ifc] = for fc > 1, and /ij/ij = /ij/ij. We do 

this by letting hk(x) = x for x G [0,1] and recursively defining . We first 
define it for x > 1 by 

hkHx) = h^J- V/W for x > 1. 

Note this is well defined recursively because if a; € [n, n + 1] the right hand side 
requires only that we know the value of h k 1 (f(x)) and f{x) G [n — l,n]. We 
also note that ft^ 1 = h^_yf~ x h^ f implies h k _ 1 h k ~ 1 = f~ 1 h k ~ 1 f, so hk-i(x) = 
f~ 1 h k ~ 1 fh k (x) for all x > 1. 

Negative values of a; are handled similarly. We define 

K\x) = fhk^h^f-^x) for x < 0. 

This is well defined recursively for x < because if x S [—71, — n + 1] the right 
hand side requires only that we know the value of h k ~ 1 (f~ 1 (x)) and f~ x {x) S 
[— n + 1, — n + 2]. Again /i^ 1 = fhk-ih^ 1 / -1 implies f~ x h k 1 f — hk-ih^ 1 so 
hk-i(x) = f- 1 h^ k 1 fh k (x) for all x < 0. 

We further note that from this definition one sees easily inductively that 
hk(x) — x for x 6 [—1, 0] for all k > 2. Finally we observe that this implies for 
x G [0, 1] we have f^ 1 h^ 1 fh k (x) = x so f~ 1 h~ 1 fh k (x) = frk-i(»)- 

It is clear from the relations [/, /ifc] = /ife— i for k > 1, [/, /i ] = ?c?, and 
/ij/ij = hjhi that the group generated by / and the h k is nilpotent of degree 
at most n. The degree of nilpotency is at least n since ho is a nontrivial n-fold 
commutator, o 

If n = 2, the group G constructed above is isomorphic to the group A/3 of 3 x 3 
lower triangular matrices. In general, G is isomorphic to a semi-direct product 
of Z n and Z where the Z action on Z n is given by the n x n lower triangular 
matrix with ones on the diagonal and subdiagonal and zeroes elsewhere. It is 
metabelian, i.e. solvable with derived length two. We will see below that this 
is a necessary condition for a smooth action on R. 

2.4 Residually torsion- free nilpotent groups 

In this section we consider some actions on R which are not irreducible, but 
which are actions of a fairly large class groups. 

Definition 2.14. A group G is called residually torsion-free nilpotent if, for 
every non-trivial element g G G, there is a torsion-free nilpotent group N and 
a homomorphism <f> : G — > N such that <p(g) is non-trivial. Equivalently, the 
intersection of every term in the lower central series for G is trivial. 

Proof of Theorem |l.0| : Since G is finitely generated it contains countably 
many elements. Let {g m \ i G Z + } be an enumeration of the non-trivial elements 
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of G. Let 4> m : G — ► N m be the homomorphism to a torsion free nilpotent group 
guaranteed by residual nilpotence, so 4> m (gm) is non-trivial. Replacing N m by 
4>m(G) if necessary we may assume N m is finitely generated. 



Let I rn = [l/(m + 1), 1/m]. Using Theorem 1.2, choose an effective action 
of N m by C 1 diffeomorphisms on the interval I m . Recall that this action has 
the property that the derivative of every element is 1 at the endpoints of I m . In 



addition, by Theorem 1.2, we may choose this action so that the derivative of 
<i>m{gi) satisfies 

\4>m{gi)'{x) - 1| < ^ 

for all x £ I m and all 1 < i < m. 

We then define the action of G by g(x) = (f> m (g)(x) for x £ I m and g(0) = 
for all g 6 G. Clearly each g m is a C 1 diffeomorphism with g' m (0) = 1. The 
action is effective because 4> m (g) acts non-trivially on I m . 

Since every element of G has derivative 1 at both endpoints of /, we may 
glue the endpoints together to give a C 1 action on S 1 . o 

It is an old result of Magnus that free groups and surface groups are residually 



torsion- free nilpotent. In particular Theorem L6 gives a C 1 action of surface 
groups on R, / and S , we do not know another proof that such actions exist. 

Another interesting example is the Torelli group T 9 , which is defined to be 
the kernel of the natural action of the mapping class group of a genus g surface 
E s on i?i(S g ,Z). For g > 3, D. Johnson proved that T g is finitely-generated, 
and Bass-Lubotzky proved that T g is residually torsion- free nilpotent. Similarly, 
the kernel of the action of the outer automorphism group of a free group is 



finitely-generated and residually torsion-free nilpotent. Hence by Theorem 1.6 
both of these groups are subgroups of Diff^M) for M = R, /, S 1 . In particular 
the Torelli group is left orderable. It is not known wether or not mapping class 
groups are left-orederable, althought Thurston has proven that braid groups are 
left-orderable. 



3 Restrictions on C 2 act ions 

In the previous sections we showed that actions by nilpotent subgroups of home- 
omorphisms are abundant. By way of contrast in the next two sections we show 
that nilpotent groups of C 2 diffeomorphisms or PL homeomorphisms are very 
restricted. In this section we focus on C 2 actions. 

3.1 Kopell's Lemma 

Our primary tool is the following remarkable result of Nancy Kopell, which is 
Lemma 1 of |]k). 

Theorem 3.1 (Kopell's Lemma). Suppose f and g are C 2 orientation pre- 
serving diffeomorphisms of an interval [a, b) or (a, 6] and fg = gf. If f has no 
fixed point in (a, b) and g has a fixed point in (a, b) then g = id. 
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We will primarily use a consequence of this result which we now present. 

Definition 3.2. We will denote by dFix(f) the frontier ofFix(f), i.e. the set 
9Fix(/) = Fix(/)\Int(Fix(/)). 



Lemma 3.3. Suppose f and g are commuting orientation preserving C 
morphisms of R, each of which has a fixed point. Then f preserves each com- 
ponent of Fix(g) and vice versa. Moreover, dFix(g) C Fix(/) and vice versa. 
The same result is true for C 2 diffeomorphisms of a closed or half-open interval, 
in which case the requirement that f and g have fixed points is automatically 
satisfied by an endpoint. 

Proof. The proof is by contradiction. Assume X is a component of Fix(g) 
and f(X) ^ X. Since / and g commute /(Fix(g)) = Fix(g) so f(X) is some 
component of Fix(g). Hence f(X) ^ X implies f(X) n X = 0. Let x be an 
element of X and without loss of generality assume f(x) < x. Dchnc 

a = lim f n [x) and b = lim f n (x). 

n — >oc n — oo 

Then at least one of the points a and b is finite since / has a fixed point. Also a 
and b (if finite) are fixed under both / and g, and / has no fixed points in (a, b). 



Thus Kopell's Lemma B.l implies g(y) = y for all y £ (a,b) contradicting the 
hypothesis that A is a component of Fix(g). The observation that dFix(f) C 
Fix(g) follows from the fact that components of Fix(/) are either points or 
closed intervals so x £ <9Fix(/) implies that either {x} is a component of Fix(/) 
or x is the endpoint of an interval which is a component of Fix(/) so, in either 
case, the fact that g preserves this component implies x £ Fix(g). 

The proof in the cases that / and g are diffeomorphisms of a closed or 
half-open interval is the same, o 



Another useful tool is the following folklore theorem (see, e.g., [F£] for a 
proof). 

Theorem 3.4 (Holder's Theorem). Let G be a group acting freely and ef- 
fectively by homeomorphisms on any closed subset of R. Then G is abelian. 



3.2 Measure and the translation number 

A basic property of finitely generated nilpotent groups of homeomorphisms of 
a one-manifold M is that they have invariant Borel measures. Of course in 
the case M = I or T 1 this follows from the fact that nilpotent groups are 
amenable and any amenable group acting on a compact Hausdorf space has an 
invariant Borel probability measure. In the case M = R this is a special case of 
a result due to J. Plante jp| who showed that any finitely generated subgroup 
of Homeo(R) with polynomial growth has an invariant measure which is finite 
on compact sets. 

We summarize these facts in the following 
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Theorem 3.1. Let M = R, S 1 , or I. Then any finitely generated nilpotent 
subgroup of Homeo(M) has an invariant Borel measure /i which is finite on 
compact sets. 

If one has an invariant measure for a subgroup of Homeo(R), it is useful to 
consider the translation number which was discussed by J. Plante in Q. It is 
an analog of the rotation number for circle homeomorphisms. 

Suppose G is a subgroup of Homeo(R) which preserves a Borel measure /x 
that is finite on compact sets. Fix a point x € R and for each / £ G define 

U{[xJ{x)) if «</(») 
r(/) = jo if * = /(*) 

The function r : G — > R is called the translation number. The following 
properties observed by J. Plante in [P] are easy to verify. 

Proposition 3.5. The translation number t : G — ► R is independent of the 
choice of x € R used in its definition. It is a homomorphism from G to the 
additive group R. For any f € G the set Fix(/) ^ if and only if r(/) = 0. 



3.3 Proof of Theorem 1.1 



Theorem 1.1 Any nilpotent subgroup of Diff 2 (7), Diff 2 ([0, 1)) or Diff 2 (S' 1 ) 



must be abelian. 



Proof. Since it suffices to show the action is abelian when restricted to any 
invariant interval we may assume our action is irreducible. 



3.3.1 The case M = I or M = [0, 1) 

The argument we present here is essentially the same as that given by Plante 



and Thurston in (4.5) of [PT]. We give it here for completeness and because it 
is quite simple. 

Consider the restriction of TV to (0, 1). If no element of N has a fixed point 
then N is abelian by Holder's theorem. Hence we may assume that there is a 
non-trivial element / with a fixed point. Thus, if h is in the center of N Lemma 



3.3 implies that Fix(/i) D <9Fix(/) which is non-empty. Another appliction 
of Lemma |3.3| , says the non-empty set dFix(h) C Fix(<?) for any g G N. We 
have found a global fixed point and contradicted the assumption that N acted 
irreducibly. We conclude N is abelian. o 



3.3.2 The case M 



Let N < Diff 2 (S" 1 ) be nilpotent. As we observed in Theorem ti.l there is an 
invariant measure /j,q for the action. If any one element has no periodic points 
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then since it is C 2 it is topologically conjugate to an irrational rotation by 
Denjoy's theorem (see e.g. ]dM| ). Irrational rotations are uniquely ergodic so 
the invariant measure must be conjugate to Lebesgue measure. It follows that 
every element is conjugate to a rotation so N is abelian. Hence we may assume 
that every element of N has periodic points. 

For a homeomorphism of the circle with periodic points, every point which is 
not periodic is wandering and hence not in the support of any invariant measure. 
We conclude that the periodic points of any element contain the support P of 
the measure ^o- It follows that that P is a subset of the periodic points of every 
element of N . 

Since N preserves fio the group N of all lifts to R of elements of N preserves 
a measure \i which is the lift of the measure no on S 1 . We can use \i to define 
the translation number homomorphism t^N — > R as described above. 

We observe that commutators of elements in N must have translation num- 
ber 0. The covering translations in N are in its center so if / and g are lifts 
of / and g respectively then [/,<?] is a lift of [/,<?]. Since t>([/,<7]) = implies 
[/, g] has a fixed point we may conclude that every element of the commutator 
subgroup N± — [N, N] must have a fixed point. Hence any commutator fixes 
every element of P because it fixes one point and hence all its periodic points 
are fixed. 

If N is not abelian there are / and g in N such that h = [/, g] is a non-trivial 
element of the center of N. Conjugating the equation f~ 1 g~ 1 fg = h by / gives 
g^fgf^ 1 = h, so fgf- 1 = hg. Repeatedly conjugating by / gives f n gf~ n = 
h n g. From this we get g~ 1 f n g = h n f n and by repeatedly conjugating with g 
we obtain g~ m f n g m = h mn f n . We conclude g- m f n g m f- n = [g m J~ n ] = h mn . 
Now let x £ P and let m and n be its period under the maps / and g respectively. 
Then h, f n and g m all fix the point x. If we split the circle at x we get an interval 
and a C 2 nilp otent group of diffeomorphisms generated by h, /" and g m . By 
Theorem 1.1 this group is abelian. Hence [g m ,f~ n ] = h mn is the identity. But 
the only finite order orientation-preservng homeomorphism of an inteval is the 
identity. We have contrdicted the assumption that N is not abelian. o 



3.4 The proof of Theorem 1.5 



Theorem |l.5| If N is a nilpotent subgroup of Diff 2 (R) and every element of N 
has a fixed point then N is abelian. 

Proof. We first show that there is a global fixed point for N. Consider Fix(h) 
the fixed poin t se t of some non-trivial element h of the center of N. We can 
apply Lemma |3.3| , and observe that for any / g N, dFix(h) C Fix(/). Thus the 
non-empty set dFix(h) is fixed pointwise by every element of N. 

If a € Fix(/i) then both [a, oo) and (— oo, o] are invariant by N and each 
is diffeomorphic to [0,1). We can thus apply Theorem JO] and conclude the 
restriction of N to each of them is abelian. o 
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3.5 The proof of Theorem \LA 



Theorem [1.4] Every nilpotent subgroup of Diff 2 (R) is metabelian, i.e. has 
abelian commutator subgroup. 



Proof. Let N < DiflT(R) be nilpotent. By Theorem 3.1 there is an invariant 
Borel measure /jonR which is finite on compact sets and from it we can define 
a translation number homomorphism : N — > R. According to Proposition 



3.5 If JVq is the kernel of r„ then every element of Ap has a fixed point. Hence 



the result follows from Theorem 1.5. o 



4 PL actions 

Recall that a piecewise linear homeomorphism of a one-manifold M is a homc- 
omorphism / for which there exist finitely many subintervals of M on which / 
is linear. Let PL(M) denote the group of piecewise-linear homeomorphisms of 
M. 

Theorem 4.1. Any nilpotent subgroup o/PL(7) or PL(5 1 ) is abelian. 

Proof. Suppose first that N < PL(J). Note that there is a natural homomor- 
phism ip : PL(7) — > R* x R* given by 

V(/) = (/'(0),/'(l)) 

As R x R is abelian ip(f) = (1, 1) for any nontrivial commutator in PL(7). 

If A is not abelian then there is a nontrivial commutator / lying in the 
center of A. Hence /'(0) = 1, so that / is the identity on some interval [0, a] 
which we take to be maximal. Since every element of N commutes with /, we 
must have that g([0, a}) — [0, a] for every g € N. But then a is also a fixed point 
of every element of A, so that / is a nontrivial commutator of elements which 
fix a. We conclude that /'(a) = 1 also. Hence / is the identity on [a, b] for some 
b > a and we contradict the maximality of a. We conclude that the center of A 
has no nontrivial commutator, so A is abelian. 

Now if A < PL(5 1 ) then the proof is nearly word for word identical to 



the proof of Theorem 1.1. We note that Denjoy's Theorem (see |dM|) is also 
valid for PL homeomorphisms of the circle. That is, any PL homeomorphism of 
5* 1 without periodic points is topologically conjugate to an irrational rotation. 
With that observation the proof tha t a PL action of A on S 1 is abel ian is 
identical to the proof of Theorem IT except that the appeal to Theorem LI in 
the case of the interval is replaced by an appeal to the first part of this theorem, 
namely the fact that a PL action of a nilpotent group on I is abelian. o 
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